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Abstract We consider multi-antenna base stations using orthogonal frequen- 
cy-division multiple access and space division multiple access techniques to 
serve single-antenna users. Some users, called real-time users, have minimum 
rate requirements and must be served in the current time slot while others, 
called non real-time users, do not have strict timing constraints and are served 
on a best-effort basis. The resource allocation problem is to find the assignment 
of users to subcarriers and the transmit beamforming vectors that maximize 
the total user rates subject to power and minimum rate constraints. In general, 
this is a nonlinear and non-convex program and the zero-forcing technique used 
here makes it integer as well, exact optimal solutions cannot be computed in 
reasonable time for realistic cases. For this reason, we present a technique to 
compute both upper and lower bounds and show that these are quite close for 
some realistic cases. 

First, we formulate the dual problem whose optimum provides an upper 
bound to all feasible solutions. We then use a simple method to get a primal- 
qq ■ feasible point starting from the dual optimal solution, which is a lower bound 

£NJ | on the primal optimal solution. Numerical results for several cases show that 

W") ■ the two bounds are close so that the dual method can be used to benchmark 

£SJ | any heuristic used to solve this problem. As an example, we provide numerical 

results showing the performance gap of the well-known weight adjustment 
method and show that there is considerable room for improvement. 
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1 Introduction 

With the ubiquitous use of smart phones, tablets, laptops and other de- 
vices, traffic demand on wireless access networks is increasing geometrically. 
Multi-antenna base stations using orthogonal frequency-division multiple ac- 
cess (OFDMA) and space division multiple access (SDMA) can transmit at 
the same time to different sets of users on multiple subcarriers. This diver- 
sity increases the system throughput by assigning transmitting resources to 
users with good channel conditions. High data rates are thus made possible by 
exploiting the degrees of freedom of the system in time, frequency and space 
dimensions. OFDMA-SDMA is also supported by WiMAX and LTE- Advanced 
systems, which are the technologies currently being set up to implement the 
fourth generation (4G) cellular networks [TJH!- 

Due to these increased degrees of freedom, it is critical to use a dynamic 
and efficient scheduling and resource allocation (RA) mechanism that takes full 
advantage of all OFDMA-SDMA transmitting resources [3]. In this mechanism, 
the scheduler selects the users that are served at each frame and the RA 
algorithm allocates to these users the transmission resources required to meet 
the quality of service (QoS) requested from the upper layers. 

In this paper, we focus on the RA part of the problem for an OFDMA- 
SDMA system supporting real time traffic with minimum rate requirements. 
We propose a dual-based method to get an upper bound to all feasible so- 
lutions. Because the dual solution is not necessarily primal feasible, we also 
present an algorithm to get a feasible point from the dual solution, which is a 
lower bound to the optimal primal solution. The importance of these bounds 
is that they give us limits on the duality gap and we can use them to estimate 
how far the solution given by any heuristic method is from the optimum. 

I.I State of the Art 

The general resource allocation is a nonlinear, non-convex program so that it 
is almost impossible to solve it directly for any realistic number of subcarriers, 
users and antennas. For this reason, most research work focuses on develop- 
ing heuristic algorithms. In this context, an important question is always how 
accurate are the results. For the resource allocation problem with rate con- 
straints, it turns out that there are very few results of that kind, as we shall 
see. 

Traffic in the system can be divided into two main groups: delay-sensitive 
real time (RT) services and delay-insensitive non real time (nRT) services. 
Early work on OFDMA systems focused on solving the RA problem for nRT 
services only, where the objective is to maximize the total throughput with 



Dual-Based Bounds for Resource Allocation in ZF OFDMA-SDMA Systems 



3 



only power constraints and possibly minimum BER constraints. In [T], the 
complete optimization problem is divided into two sub-problems: Selection of 
users for each carrier and then power allocation to these users, which arc both 
solved by a heuristic. A similar approach using zero-forcing (ZF) beamforming 
is reported in [S]. The work of [HE] does not solve the complete optimization 
problem; instead, it separates it into uncoupled subproblems that provide sub- 
optimal solutions. 

There is a definite need to benchmark the performance of these heuristic 
algorithms. For the RA problem with nRT traffic only, several methods have 
been proposed to compute near-optimal solutions. For example, genetic al- 
gorithms are proposed in [6] while [7,8,9,10 provide methods to compute a 
near-optimal solution based on dual decomposition. In addition to providing 
a benchmark, near-optimal algorithms can also lead to the design of efficient 
RA methods as shown in [TO], where heuristic algorithms derived from the 
dual decomposition method are proposed. 

Several methods have been used to solve the RA problem for OFDMA- 
SDMA systems with both RT and nRT traffic. In [TT], the objective is to max- 
imize the sum of the user rates subject to per-user minimum rate constraints 
that model the priority assigned to each user at each frame. The optimization 
problem is solved approximately for each frame by minimizing a cost function 
representing the increase in power needed when increasing the number of users 
or the modulation order. The advantages of this approach are that it handles 
user scheduling and resource allocation together and supports Rt and nRT 
traffic. Its weaknesses are that no comparison is made against a near-optimal 
solution and the method used to determine user priorities at every frame is 
very complex. 

In [T^] , both RT and nRT traffic arc supported. Priorities are set according 
to the remaining deadline time for RT users and to the difference between the 
achieved rate and the desired rate required for nRT users. The user with the 
highest priority is paired with the subchannel with the highest vector norm and 
semi-orthogonal users are multiplexed on the same subchannel. Comparisons 
against the algorithm of [TT] show that the packet drop rate for RT users 
is significantly reduced. The algorithm's complexity is also reduced because 
of the semi-orthogonality criteria used to add users. However, as in [JT], a 
performance comparison with a near-optimal solution is not provided. 

In [13) . the objective is to maximize a utility function without any hard 
minimum rate constraints for the RT users. The channel quality information is 
added to the utility function to favor users with good channel conditions and 
priorities are set by increasing user weights in the utility function. The advan- 
tage is that the per-frame optimization problem has only a power constraint 
and no rate constraints, which makes it simpler to solve. The disadvantage 
with this reactive approach is that RT users with poor channel conditions are 
backlogged until their delay is close to the deadline, increasing the average 
delay and jitter. 

In [14] . a heuristic algorithm is proposed for the sum rate maximization 
problem with proportional rates among the user data rates, i.e., the ratio 
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among allocated user rates is predetermined. The criteria to form user groups 
includes semi-orthogonality as in [12] . but also fairness through proportional 
rate constraints. This method is extended to include hard minimum rates 
in |15j which attempts to solve exactly the same problem we formulate in 
section [5J Again, there is not reported method to evaluate the accuracy of 
these heuristics, except by comparing them to each other. 

Another approach is to maximize the sum rate subject to constraints on 
the average rate delivered to a user |16j . However, unlike the work presented 
in [17] where an optimal solution is provided for the single antenna OFDMA 
RA problem with average rate constraints, the algorithm presented in |16j is 
a heuristic approximation. Note also that with average rate constraints, RT 
users tend to be served when they have good channel conditions which can 
create unwanted delay violations and jitter. 

1.2 Paper Contribution and Organization 

None of the previous work provide a near-optimal solution to the OFDMA- 
SDMA RA problem with minimum rate requirements. This is important not 
only as a benchmark for any heuristic algorithms, but also to get a better 
insight into the problem and to help devise efficient heuristics. 

The main contribution of this paper is a method that provides an upper 
bound to the following OFDMA-SDMA RA problem for mixed RT and nRT 
traffic: For a given time slot, find the user selection and beamforming vectors 
that maximize a linear function of the users rates, given a total transmit power 
constraint and minimum rate constraints for RT users. The user weights in the 
linear utility function are arbitrary and can be the result of a prioritization 
or fairness policy by the scheduler. We solve the RA problem by Lagrange 
decomposition and we show, for small cases where we can find the optimal 
solution, that the duality gap is small. 

A second contribution is a simple off-line heuristic algorithm to compute 
a feasible point based on the dual solution. This point is a lower bound for 
the optimal solution. This lower bound, in conjunction with the upper bound 
from the dual, can be used to limit the optimality gap in larger cases where 
an optimal solution is not available. 

We then study several cases where we compare the performance of the 
upper and lower bounds. The results show that the two bounds are tight 
when the number of RT users is small and that their difference increases for 
larger values but that it stays quite small. Thus, the dual method provides a 
good approximation to the optimal solution. We also compare the performance 
of the weight adjustment algorithm versus the solution provided by the two 
bounds. The results indicate that adjusting the user weights to prioritize RT 
users can lead to significantly sub-optimal solutions. 

We describe the system and formulate the optimization problem we want 
to solve in Scction[2]where we also briefly discuss a direct enumeration method 
to find the optimal solution for small problems. We present in Section [3] the 
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dual method and two algorithms: One that finds the dual solution (the upper 
bound) and the other that finds a dual-based primal feasible solution (the 
lower bound). In Section |4l we present numerical results showing the accuracy 
of the upper and lower bounds and of the weight adjustment algorithm for 
different scenarios. Finally, we present our conclusions in Section [5]. 



2 System Description and Problem Formulation 

We consider the resource allocation problem for the downlink transmission in a 
MISO system with a single base station. There are K users, some of which have 
RT traffic with minimum rate requirements while the others have nRT traffic 
that can be served on a best-effort basis. The BS is equipped with M transmit 
antennas and each user has one receive antenna. In this configuration, the BS 
can transmit in the downlink data to different users on each subcarrier by 
performing linear transmit beamforming precoding. At each OFDM symbol, 
the BS can change the beamforming vector for each user on each subcarrier to 
maximize some performance function. In this paper, we assume that we use a 
channel coding that reaches the channel capacity. The data rate are in units of 
bits per OFDM symbol, or equivalently bits per second per Hertz (bps/Hz). 



2.1 Signal Model 

First, we describe the model used to compute the bit rate received by each 
user. Define 

Sk, n the symbol transmitted by the BS to user fc on subcarrier n. We as- 
sume that the §k, n are independently identically distributed (i.i.d) random 
variables with §k, n ~ CM(0, 1). 

Wfc,„ an M-component column vector representing the beamforming vectors 
for user k on subcarrier n. Unless otherwise noted, we denote w the vector 
made up by the column stacking of the vectors Wfc >n . 

x n an M-component column vector representing the signal sent by the array 
of M antennas at the BS for each subcarrier n. 

hfc jn an M-component row vector representing the channel between the M 
antennas at the BS and the receive antenna at user k for each subcarrier 
n. 

Zk, n the additive white gaussian noise at the receiver for user k on subcar- 
rier n. The Zk, n are i.i.d. Gaussian random variables and, without loss of 
generality, we assume that they have unit variance, that is Zk. n ~ CAf(0, 1). 

yk,n the signal received by user k on subcarrier n. 

r k n ^ ne ra te of user k on subcarrier n in bps/Hz. 
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The signal vector x„ is built by a linear precoding scheme which is a linear 
transformation of the information symbols §k n '■ 



K 

x ra = y"]wfc |Tt Sfc, ra . (1) 
fc=i 

The signal received by user k on subcarrier n is then given by 

= h-k t nWk,nSk,n + ^ h-k,nWj,n8j,n + z k.n- (2) 

The second and third terms in the right-hand side of ([5]) correspond to the 
interference and noise terms. Since the signals and noise are Gaussian, their 
sum is also Gaussian and the data rate of user k for subcarrier n is given by 
the Shannon channel capacity for an additive white Gaussian noise channel: 



rL (w) = log 2 ( 1 + —p*^ , 2 ) • (3) 



2.2 Rate Maximization Problem 

The general rate maximization problem corresponding to the OFDMA-SDMA 
RA problem with mixed RT and nRT traffic is to find a set of beamforming 
vectors Wk,n that will maximize the weighted sum of user rates. This is limited 
by the total power available for the transmission at the base station and some 
users with real time QoS requirements must receive a minimum rate. More 
precisely, we assume that we know 

K Number of users in the cell. 

K, Set of users in the cell: {1, . . . , K}. 

T> A subset of K. containing the users that have minimum rate requirements. 

We define D = \V\. 
dk Minimum rate requirement for user k. 
M Number of antennas at the BS. 
N Number of subcarriers available. 

P Total power available at the base station for transmitting over all channels. 
Cfe Weight of the user rates in the objective function. These could be computed 
by the scheduler to implement prioritization or fairness. 
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We then want to solve the following optimization problem to obtain the re- 
source allocation 

N K 

max 5I5I cfer °-«( w ) ( 4 ) 

n=\ fc=l 

N K 

71 = 1 k=l 

N 

5>° )n (w)><4, VfceP. (6) 

n=l 

The total transmit power is represented by the sum of the L 2 norms of the 
beamforming vectors in constraint ([5]). The achievable rate over all subcarriers 
should be higher or equal than the required minimum rate per user as in ©. 

Problem (j^HB]) is a non-convex, non-linear optimization problem. Using an 
exact algorithm to find a global optimal solution is very hard considering the 
size of a typical problem where there can be up to a hundred users and hun- 
dreds of sub-channels. Another option is to use a standard non-linear program 
(NLP) solver to compute a local optimal solution and use different starting 
points in the hope of finding a good global solution. The problem with this 
approach is that 1) we don't know how close we are to the true optimum and 
2) the technique is quite time-consuming. 

Nevertheless, we tried this approach for some small cases and observed that 
most users end up with a zero beamforming vector and only a small subset of 
users actually get some rate, often no more than M, Furthermore, in accor- 
dance to what was reported for the SDMA problem in [IB], we observed that 
at high SNR, a so-called zero-forcing (ZF) solution is very close to the local 
optimum. This ZF solution can be easily computed by channel diagonalization 
and water-filling power allocation and is near-optimal compared to the general 
beamforming solution in the high SNR regime. Moreover, due to multi-user 
diversity, there is a good chance of finding users with high SNR channels when 
the total number of users increase. Therefore, in a multi-user Rayleigh fading 
environment, the ZF beamforming technique can provide results close to the 
general beamforming solution, even in the moderate SNR regime. For these 
reasons, we now turn to the so-called Zero-Forcing beamforming strategy. 



2.3 Zero-Forcing Beamforming 

In general, user k is subject to the interference from other users which reduces 
its bit rate, as indicated by the denominator in Q. Zero- forcing beamforming 
is a strategy that completely eliminates interference from other users. For each 
subcarricr n, we choose a set s of g < M users which are allowed to transmit. 
This is called an SDMA set. We then impose the condition that for each user 
k in this set, the beamforming vector of user k must be orthogonal to the 
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channel vectors of all the other users of the set. This amounts to adding the 
orthogonality constraints 

hfc.nW^n =0 j ^ k, j, fees (7) 

and the user k data rate for subcarrier n then simplifies to: 

r tn ( w fc,«) = l°g 2 (l + |hfe.„w fe ,„| 2 ) . (8) 

With ZF beamforming, the problem is now made up of two parts. We need to 
select a SDMA set s(n) for each subcarrier n and, for each selected SDMA set, 
we must compute the beamforming vectors in such a way that the total rate 
received by all users is maximized. Because of this, we need to add another 
set of decision variables 

a.k,n a binary variable that is 1 if we allow user k to transmit on subcarrier n 
and zero otherwise. We denote the collection of a.k,n by the vector a . 

This results in the following ZF problem 

N K 

maX EE Cfcr °,™( Wfe <") ( 9 ) 

W,CK * ' * ' ' 

n=l fc=l 

w fc ,„|| 2 <P (10) 



N K 

EE"- 

n=l k=l 
N 

E r fc,«(w fc ,„)>4, %eD (11) 

n=l 

K 

a k,n < M, Vn (12) 

fc=l 

|h fc ,„w,. n | 2 < B [(1 - a fc . n ) + (1 - aj, „)] , Vn, Vfc, Vj, k^j (13) 
||w fc , n || <Aa k , n (14) 
a k , n e{0,l} (15) 



where A and B are some large positive constants. Constraint (|12l) guarantees 
that we do not choose more than M users for each subcarrier, constraint p^|) 
guarantees that if we have chosen two users k and j, they meet the ZF con- 
straints and is redundant for other users, and constraint (|14[) guarantees that 
the beamforming vector is zero for users that are not chosen. Problem (OHU) 
is a non-linear mixed integer program (MIP) and these are known to be very 
hard to solve exactly. 

In this paper, whenever we need to get an exact solution, we use a complete 
enumeration of the binary variables a satisfying the constraints (jT2"j) . For each 
a, we then find the beamforming vectors maximizing the utility function given 
the power, minimum rate and ZF constraints. The optimal solution is the vec- 
tor a that maximizes the utility function. The problem of finding the optimal 
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w variables for a particular a is a relatively small non-convex problem. Using 
the pseudo- inverse approach to satisfy the ZF constraint (see Section l3~3")) . it 
can also be transformed into an approximate convex problem and solved using 
a dual algorithm similar to the one described in Section [3.41 

It would seem that the zero-forcing model is not improving things much: 
We have gone from a non-convex nonlinear program to a non-convex mixed 
nonlinear program that can be solved by picking the global solution from a 
large collection of small convex problems. However, as we explain in section [31 
this allows us to design an efficient and accurate algorithm. 



3 Dual-Based Solution Method 

Obviously, we cannot solve problem (|9l ll5[) fast enough to use it in real time. 
Not only is it NP-complete [3] but the actual computation time becomes 
quickly prohibitive for realistic sizes, even for off-line computations. Still, we 
need to compute solutions so that we can use them as benchmarks to evaluate 
the quality of real time heuristic approximations. We now present two off-line 
solution techniques that are tractable for problems of realistic size based on 
the Lagrange relaxation of the primal. Because problem (|H Hl5|) is not convex, 
there will often be a strictly positive duality gap at the solution of the dual. 
However, if it is small enough, we can use the solution provided by the dual 
method as a useful benchmark to check the accuracy of heuristic methods. 
Results in section [4] show that in many cases, the duality gap is in fact less 
than a few percent. 

Solving the ZF problem will require some form of search over the ak^n vari- 
ables. Note that this ranges over all subsets with a number of users smaller 
than or equal to M, so that the search space is going to be fairly large. Our 
first transformation is thus to separate the problem into singlc-subcarrier sub- 
problems. For this, we dualize the constraints (TIU]) and (fTTj) since they are the 
ones that couple the subcarriers. Define the dual variables 

A Lagrange multiplier for power constraint (|10p . 

fik Lagrange multipliers for minimum rate constraint (jlip of user k. The col- 
lection of fik is denoted /x. 

In order to simplify the derivation, we also define the dual variables fx^ for all 
users k G fC. For users with no minimum rate requirements (fc ^ £>), we have 
j-ik = and dk = 0. In what follows, we use the standard form of Lagrangian 
duality which is expressed in terms of minimization with inequality constraints 
of the form <. Under these conditions, the multipliers A, fi > 0. We get the 
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partial Lagrangian 

N K 



n=l k=l 
K 

E^ 

k=l 



N K 

EE 



p 



n=l k=l 



N 



E - r k,n( w k,n) + d k 



.71=1 



K N ( K K \ 

= -\p+Y,L i kd k + Y,\ -E( cfe +^) r °,™( w ^) + A Eii w ^n 2 f 

fc=l 71=1 I. fc=l fc=l J 

(16) 

with constraints p^1 - [T5|) . The value of the dual function at some point (A, n) 
is obtained by minimizing the Lagrange function over the primal variables 



<9(A, /i.) = min £(A, /x, w, a.) 



(17) 



and the dual problem is 



max (9(A, fi) 

A,/x 

A,/x > 



(18) 
(19) 



which we can solve by the well known subgradicnt algorithm [19) . From now 
on, we concentrate on the calculation of the subproblcm (IT71) . 



3.1 Subchannel Subproblcm 

Because of the relaxation of the carriers coupling constraints (fTUl - [TTj) . the 
subproblems in (fTT|) decouple by subcarrier since the objective is separable 
in n and so are constraints (|12H14j) . Computing the dual function then requires 
the solution of N independent subproblems. For each subcarrier n, this has 
the form 

K K 



min -J2( c k+^)r° k . n (w k , n ) + Xj2\\^k,n\\ 2 (20) 

k=l k=l 
E a *,n ^ M > ( 21 ) 



lhfc.nWj.nl 2 < B [(1 - Q fc . n ) + (1 - Qj, „)] , Vfc, Vj, k ^ J (22) 

||w fc , n || < Aa k , n (23) 
£*k,n e {0, 1} 

where w n is the vector made up by the column stacking of the vectors Wk, n 
for subcarricrs n and cc„ denote the collection of ak. n for subcarrier n. Prob- 
lem (|2"01 - l2"3l is still a mixed NLP, albeit of a smaller size. 
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3.2 SDMA Subproblem 

A simple solution procedure is to enumerate all possible choices for a>k,n that 
meet constraint (fT2|) . This is called the extensive formulation of the problem. 
Each choice defines a SDMA set s and k = \s\ and here, we present a so- 
lution technique for the subproblems with given s. For each s, the problem 
separates into k independent problems to compute the optimal beamforming 
vector Wfc : „ iS for each user k <S s. For each user k <G s we know the set of 
channel vectors for the other members of s and we collect these vectors in the 
(« — 1) x M matrix Hfc n s . Problem ([20H23]) can then be rewritten as 

min / ng (24) 

3 

/n, S = £/**„, s (25) 
k£s 

where n s is given by the solution of the optimization 

f* k ,n,s = min -c' fc log 2 (1 + |h fe w fc ,„, s | 2 ) + A||w fc ,„, s || 2 (26) 
H fe ,„, s w fe ,„ iS = (27) 

where c' k — + fik, Wk,n,s is the beamforming vector for user k on subcarricr 
?? for SDMA set s, and w„. s is the vector made up by the column stacking of 
the vectors Wk,n,s for the k users in s. Note that constraint (|21[) is automati- 
cally satisfied by the construction of s, constraint (f2"3"f simply drops out since 
Wk,n,s = for k s and constraint (|2^|) remains only for k 6 s, but we write 
it as (|2"7)l because we are considering only users that belong to SDMA set s. 

This is certainly not a feasible real-time algorithm, but for realistic values 
of K and M the number of SDMA sets is still manageable and the optimization 
sub-problem (|24H27p is a small nonlinear program with M variables and k — 1 
linear constraints. It can thus be solved quickly by a number of techniques. 
Still, the overall computation load can be quite large. There will be k such 
problems to solve for each SDMA set, and there are S = Yli=i (T) sucn se ^ s 
for each of the N subcarriers so that we have to solve the problem k x S x N 
times, and this for each iteration of the subgradient algorithm. Clearly, any 
simplification of the beamforming subproblem can reduce the overall compu- 
tation time significantly. 



3.3 Approximate Solution to the Beamforming Problem 

This can be done by the following construction. Instead of searching in the 
whole orthogonal subspace of Hk, n ,s as defined by (j2~?| . we pick a direction 
vector in that subspace and search only on its support. This will give a good 
approximation to the extent that the direction vector is close to the optimal 
vector. The choice of direction is motivated by the fact that the objective 
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function depends only on the product h^w^ n s . We then introduce a new 
independent variable 

qk,n, s = h fc w fcj „, s (28) 



and because this variable is not independent of Wk. n ,s, we add (|28|) as a con- 
straint. We then get the equivalent problem 

max c' fc log 2 (1 + |<7fc,,i, s | 2 ) - A||w fej „ iS || 2 (29) 

hfcW fc: „ iS = q k . n , s (30) 

'H-k,n,s'^k,n,s = 0. (31) 

Constraints (]30[) and (|31[) can then be rewritten in the standard form Gk,n,s^k,n 
= bfc : „ iS where the Gk, n ,s matrix is the concatenation of and Hk, n .s and 
bfc, n , s = [qk,n,s,0,0- ■ -0] T . 

Since we are proposing to transform the constrained optimization over 
the k variables into an unconstrained optimization over qk, n ,s only, we must 
be able to express ~Wk,n,s as a function of qk.n.s- The linear system being 
under-determined, this is obviously not unique. We propose to use G^ n s , the 

pseudo-inverse of Gk, n ,s, for the back-transformation Wk, n , s = G^ n Jak,n,s- 
The pseudo-inverse picks the vector of minimum norm compatible with the 
linear system. In other words, choosing this transformation will minimize 
\\~^k.n,s\\ so that it is minimizing the power term in the objective function 
in (|2"9"1) . Because A > 0, this has the effect of contributing to the maximiza- 
tion of n s . Note that this technique provides only an approximate solution 
of the beamforming problem; we cannot invoke Theorem 1 from |20j which 
shows that in certain cases, the pseudo-inverse transformation is optimal. A 
strong assumption for the theorem is that the objective function depends only 
on the qk, n ,s variable, which is not the case here since (|29[) also depends on 
||wfc : „ iS || 2 . However, we observed from numerical results that the difference 
between the pseudo-inverse solution and the optimal solution is small. With 
this approximation we fix the direction of the beamforming vectors to 

1+ v. 

'k,n,s Uk , n , s 

=Qk,n,a[ G t,n,ah 

where [G^Ji denotes the first column of G^ ns . Now, we can obtain a 
problem formulation in terms of the user powers only by replacing the following 
expression in P^]) : 

||wfc,„, s || 2 = 7fc,„, s Pfc,n, S , (32) 

where Jk,n,s = IIIG^nJ 1 !! an( iPfc,n,s = \qk,n,s\ 2 - Adding the constraint pk, n ,a > 
0, we get the equivalent problem 

max c' fc l0g(l + Pk,n,s) - ^lk,n.sPk.n,s (33) 
Pk,n,s > (34) 



Dual-Based Bounds for Resource Allocation in ZF OFDMA-SDMA Systems 



13 



which has the solution 

Pk,n,s = max \ 0, — -£ 1 \ (35) 

so that the computation time is basically that for computing G^~ n s . Also note 
that using Gt we can also find the optimal beamforming vectors for all 
users in s, the only difference being that 7fc, n . s is computed using the column 
of G£ n s corresponding to the channel vector of this user. 



3.4 Solving the Dual Problem 

To summarize, the dual function (9(A, n) is obtained for the current values of 
the multipliers by finding for each subcarrier n = 1,...,N the optimal SDMA 
set s*(n) to the minimization problem in (|24[) . where 

/n,s(A,/x) [c'fclogt 1 +Pn,s,k) ~ ^k,n,sPk,n,s\ (36) 

k£s 

and pk, n ,s is given by ((35|) . Substituting back in ((l"7)) . the dual function is 

a: at 

0(X, n) = -XP + Mfc4 + min/n.^A, ft) (37) 
fe=l n=l 

with f njS given by p6p . For any value of the dual variables (A,/x) we can 
determine the optimal primal variables (a,w); a is obtained by the optimal 
subcarrier assignment vector s(n) after performing the minimization over s in 
(|37[) . and the optimal beamforming vectors w* fc for the users k 6 s*(n) are 
given by 

w;, fc = G+ riiS , (n) [p^ ( „ ) ,0,...0] T (38) 

The largest part of the computation to evaluate the dual function is the 
calculation of G^ „ s which has to be done for each subchannel and each pos- 
sible SDMA set. The number of evaluations can become quite large but the 
size of each matrix is relatively small so that the calculation remains feasible 
for medium-size networks. Furthermore, while solving the dual problem re- 
quires multiple subgradient iterations, the calculation of the pseudo-inverses 
is independent of the value of the multipliers. This means that the calculation 
of Gt n . can be done only once in the initialization step of the subgradient 
procedure. 

Note that if the algorithm finds an optimal solution, the corresponding 
primal computed from the optimization of the Lagrange function will be fea- 
sible since the subgradients and g\ are small . We use the (somewhat 
inappropriate) expression "dual feasible" to denote such a solution. If, on the 
other hand, the algorithm stops before reaching the optimum, the primal will 
generally not be feasible. 
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Algorithm 1 Calculation of the Dual Problem 

Construct the set S of all subsets of users of size 1 < k < M 
for all n = I . . . N do 
for all s £ S do 
for all k 6 s do 

Compute the pseudo-inverse n g and Jk,ri,s 
end for 
end for 
end for 

Choose an initial value A" and /i° 

Subgradient iterations. We set a limit of I m on the number of iterations 
for all i = 1 . . . I m do 

Solve the N subproblems (I24B to compute the dual function 

Compute the subgradients: 



<?a = E„E fces *(„) ll w fc,JI 2 - p 

if llflull ^ e an d UsaII ^ e then 

Exit. A dual optimal solution has been found, 
else 

Update the multipliers 



end if 
end for 

Exit. A dual optimal solution was NOT found. 



Algorithm [T] finds the optimal dual variables (A*,/x*) that solve the dual 
problem fj 18|) using the subgradient method |19) with a fixed step size 8 and 
therefore yields an upper bound to problem (|9l ll5p . In algorithm[TJ the pseudo- 
inverse matrices G~£ n s can be computed by any number of well known algo- 
rithms. Here, we have used the Matlab command pinv [3T|. Note that this 
algorithm can be used to solve the beamforming problem or equivalently the 
power allocation problem for a fixed SDMA set assignment. The only differ- 
ence is that ([24]) becomes trivial since there is only one possible SDMA set 
per subcarrier. 

It is not possible to evaluate the overall complexity of algorithm [1] because 
we don't have a bound on the number of dual iterations. We can nevertheless 
give a bound on the complexity of one iteration since it is dominated by the 
pseudo-inverse matrices computation. We have to compute TVS' ~ NK M ma- 
trix inversions each one with complexity 0(M 3 ), giving a total computational 
complexity 0(NK M Al 3 ). Computing the subgradient vectors and updating 
the dual variables have much lower complexity than the pseudo-inverse matri- 
ces computation. 



3.5 Analysis of the Dual Function 

Lets denote 0* the maximum of the dual function <9(A,/x) over (A, fi) > 0. 
If U 1 is the weighted sum-rate objective function achieved by any feasible 
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0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 

H, rate constraint dual var. — > 

Fig. 1 Contours of Dual Function, Single RT User. Parameters N = 8, K = 8, M = 3, P = 
20 dBm, di = 50 bps/Hz 

point in the primal problem and U* its optimum value, then the following 
inequalities hold [35] 

U 1 < U* < -0* < -<9(A, n) (39) 

The value —6**, or any feasible approximation — 0(X, /x) to it, is thus an upper 
bound to the optimum value of the primal problem U*. Thus, — &* can be 
used to benchmark any other solution method. 

Figure ffl shows a contour plot of the dual function 6>(A, /x) for the case of 
one RT user. The diamond marker shows the maximum. 

We can get some insight on the shape of the dual function from figure [5] 
where we plotted the function with respect to fi for a fixed value of A. The 
solid line curve corresponds to the same dual function as in figure [TJ where 
the rate constraint is active, d\ = 50 bps/Hz. We see that the dual function 
goes through a maximum at /i = 0.24. We have also shown the case where 
we increase the minimum rate constraint so much that the problem becomes 
infeasible, e.g., we make d\ = 100 bps/Hz. As expected from duality theory, 
the dual function has no maximum since lim^oo <9(A, /x) = oo as shown by 
the dash-dotted curve. Finally, the dashed curve at the bottom corresponds 
to di = bps/Hz such that the constraint is inactive and the solution where 
the maximum occurs is located at \i\ =0. 

For completeness we show in Figure |3] the dual function as a function of 
A when the rate constraints are feasible. The dual function increases rapidly 
and reaches a maximum at A = 1.83. 
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Fig. 2 Dual Functions for Different Rate Constraints, A = 1.83 



3.6 Dual-Based Primal Feasible Method 

The SDMA set selection and beamforming vectors found by Algorithm[TJdo not 
always provide a primal feasible solution. The rate or power constraints might 
be violated whenever the algorithm stops because the number of iterations has 
been reached before the convergence rule is met. In this subsection, we propose 
a simple procedure to obtain a feasible point to problem dHHISl) from the dual 
solution found with Algorithm [TJ This point is not optimal but because we 
start from the dual optimal solution, we expect that it will be close to the 
optimal solution. Obviously this will give us a lower bound to the optimal 
primal solution. 

Algorithm [2] summarizes this method. The algorithm begins by solving the 
dual problem (fT5|) using Algorithm [TJ If the solution is not feasible either di- 
rectly or by recomputing the power allocation for the SDMA set assignment 
found in the dual problem, the algorithm performs a search by increasing 
the dual variables associated to the users whose QoS constraints are not met 
until a new SDMA set assignment is found. It then solves the power alloca- 
tion problem for this new SDMA set assignment and checks if the minimum 
rate constraints are met. The search for new SDMA sets continues using this 
method until a feasible SDMA set assignment is found or a maximum number 
of iteration is reached. 

Algorithm [2] invokes algorithm [TJ which has complexity 0{NK M M 3 ). As- 
suming that the maximum number of iterations Im is fixed independently of 
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Fig. 3 Dual Function vs. A, fi = 0.24 



the problem parameters, the computational complexity of the feasible point 
search is 0(NK ) for the subcarrier reassignment and 0(N(D + K)) for the 
power allocation. These are lower than the computational complexity of al- 
gorithm [TJ Therefore, the computational complexity of algorithm [2] is also 
0(NK M M 3 ). 



In contrast to the enumeration method described in Section I2.3I which 
performs an enumeration of all possible SDMA set assignments, the dual-based 
Algorithm [5] is a method that finds new candidate SDMA set assignments close 
to the dual optimal and then uses them to solve a simple power allocation 
problem until the rate and power constraints are met. This makes the search 
for a near-optimal feasible point much faster than finding the exact solution. 
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Algorithm 2 Calculating a Feasible Point from the Dual Solution 

Solve the dual problem I I18H using algorithm [T] This yields the optimal dual variables 
A*,/iJ and a SDMA set assignment vector s*(n) for each subchannel n. 
Set sg(ra) = s*(n) 

Evaluate total power and user rate constraints I11UH11H 
if All constraints are met then 

Exit. A feasible solution has been found, 
end if 

Compute power allocation problem for s[j(n) and evaluate total power and user rate 

constraints lUOHllll 

if All constraints are met then 

Exit. A feasible solution has been found, 
end if 

Compute the multipliers /ij. for users k such that < 
for j = 1 to J do 
Mfc = Mfc + S 

Find s° = argmin s {/ njS } 

where f„ yS is given by (125 I t for the current dual variables A,// 
Let s°(n) be the SDMA assignment found 
if s|(n) + s°_ x (n) then 

We have found a new SDMA assignment 

Compute power allocation problem for s° (n) and evaluate total power and user rate 

constraints UOHllll 

if All constraints are met then 

Exit. A feasible solution has been found, 
end if 
end if 
end for 

Exit. A feasible solution was not found. 



4 Performance Analysis 

In this section, we present some numerical results on the performance of the 
dual-based algorithm and the accuracy of the upper and lower bounds. To 
show how they can be used to evaluate heuristic algorithms, we also compare 
them with the solution provided by a weight adjustment method described in 
Section [O] 



4.1 Convergence of the Dual Algorithm 

First we present in Figure|3]the value of the dual function and Lagrange multi- 
pliers as a function of the number of iterations for a given channel realization. 
The corresponding transmit power and the rate received by the RT user are 
shown in Figure [5j The parameters used for the calculation are listed in the 
figure titles. We see that the algorithm converges very quickly to a solution 
that is both close to the minimum value and feasible. This is typical of several 
other configurations, except that the number of iteration increases with the 
number of RT users. 
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Fig. 5 Power and rate constraints for M = 3, K = 16, N = 16, P = 20 dBm, D = 1 and 
di = 80 bps/Hz. 
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4.2 Weight Adjustment Heuristic 

As discussed in Section 11.11 several RA algorithms provide support for users 
with RT traffic by increasing the user weights in the utility function until they 
receive enough transmission resources. In this section, we describe a generic 
weight adjustment method which will be used to show that this technique 
leaves much room for improvement. 



Algorithm 3 Weight Adjustment Algorithm 

Solve RA problem (T&I 4 151) without minimum rate constraints constraints Jill) 
c' <— c 

Let r k be the achieved rate for user k at every iteration 
iteration <— 1 

while (rj, < rffe for one or more users k S T>) AND (iteration < /) do 

Increase user weight using d, = d, + e (d k — r^) for users in need, where < e < 1 
Solve RA problem ||9 U15H without minimum rate constraints (1116 using user weights c' 

iteration <— iteration +1 
end while 



We want to find a set of weights in the utility function © such that 
the rate requirements of the RT users are met when we solve problem ([9]- 
[T"5]) without the rate constraints ([TTj) . Also, the set of weights must not be 
very different from one user to the other in order to maximize the multi- 
user diversity gain. Algorithm [3] implements a generic method that can do 
this. It increases the user weights for RT users until enough resources are 
allocated to meet the minimum rate requirements. The parameter e controls 
how much the weights are increased with respect to the rate bounds. The 
rates achieved by Algorithms [3] and [5] arc different since they solve different 
problems. Algorithm [3] can be seen as solving problem (| MT5|) by using a linear 
penalty method for constraints (fTTj) of the form 

P k = min {0, r k - d k } ■ 

The modified objective function is then 

Up = C ^k + Pk 
k 

= ]Tc fc r fc + e ( r k-d). (40) 

k k\r k <d 

At each iteration of the penalty method, whenever rate constraints are ac- 
tive, the solution of (|40)l cannot be smaller than that of ([9 HT5]) since it is a 
relaxation. Notice that problem (|40l) is quite simple since it has a single con- 
straint for the transmit power but it has to be solved many times to adjust the 
weights of the real time users. In weight adjustment algorithms such as [13j . 
the user weights are increased at each time slot using an increasing function of 
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Method 


Minimum rate (bps/Hz) 


13.33 


16.66 


20 


Dual-based upper bound (bps/Hz) 


49.13 


47.12 


40.8 


Primal enum. gap (%) 


0.57 


0.55 


0.10 


Dual-based feas. gap (%) 


0.57 


0.59 


0.04 


Weight mod. gap (%) 


0.68 


0.71 


0.15 



Table 1 Average performance gap against the dual optimal upper bound for small system 
configuration. 



the packets delay, so the computation task is distributed over time. However, 
this distributed approach does not guarantee that the rate requirements are 
met in a given time slot which can lead to delay violations and jitter. 

4.3 Parameter Setup and Methodology 

We now present the method and parameter values used to compare the per- 
formance of the different methods to solve problem (JSJ). We used a Rayleigh 
fading model to generate the user channels such that each component of the 
channel vectors h.k,n are i.i.d. random variables distributed as C/V(0,1). We 
also assumed independent fading between users, antennas and subcarriers. Un- 
less otherwise noted, we used a configuration with M = 3 antennas, K = 16 
users and N = 16 subcarriers. We have only one RT user when we examine 
the effect of various parameters and we also look at the impact of increasing 
the number of RT users. The minimum rate constraint was set at 40 bps/Hz 
unless otherwise stated. We also fixed the power constraint to P = 20 dBm 
and used a large-scale attenuation of dB for all users. The user weights in (j9|) 
were set to Ck = 1 for all users. The results are the average over the feasible 
cases from 100 independent channel realizations. 

We compared the performance of the different methods for various scenar- 
ios where we increased the resource requirements for the RT users until the 
minimum rate requirements can no longer be met for all RT users. For each 
scenario and channel realization, the upper bound was computed from the 
dual solution using Algorithm [T] described in Section 13.41 For small systems, 
we also found the exact solution using the primal enumeration method given 
in Section [2. 31 We also computed the lower bound given by dual-based primal 
feasible Algorithm [5] and the heuristic solution provided by the weight adjust- 
ment Algorithm [3] described in Section 13.61 and 14.21 We use the upper bound 
given by the dual optimal solution as the reference point when computing the 
gap when the exact solution is not available. 

4.4 Single User, Increasing Minimum Rate 

In this first scenario, we have a single RT user and we increase its minimum 
rate d\. First we consider a small system with K = 4 users and N = 2 
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Method 


Minimum rate (bps/Hz) 




80 | 100 | 120 


Total rate gap against the upper bound (%) 


Dual-based fcas. 


0.24 


0.23 


0.21 


Weight mod. 


9.49 


7.30 


3.36 



Table 2 Average total rate gap as a function minimum rate requirement. 
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Fig. 6 Average total rate as a function of the minimum rate requirements 

subcarriers where it is possible to compute an exact solution. We present in 
table ffl the average gap in percent between the three methods used to find 
feasible solutions against the dual upper bound for a small system. As the 
required minimum rate increases from 13.33 to 20 bps/Hz, the upper bound 
decreases as more resources need to be assigned to the RT user until the 
problem is no longer feasible. For this small configuration, we see that all 
methods give excellent results and the duality gap is very small. 

In the remaining results, we use a larger system with K = 16 users and 
N = 16 subcarriers. With these values, it is no longer possible to use the 
primal enumeration method and we compute the gap relative to the dual 
upper bound. We present in Table [2] the difference in percentage between 
the bound and the solutions of the dual feasible and the weight adjustment 
algorithms. The dual feasible algorithm gives a lower bound within 0.25% of 
the dual upper bound while the weight adjustment solutions difference can be 
almost 10%. As discussed in Section POl this is due to the fact that the weight 
adjustment algorithm stops as soon as it finds a feasible solution and does not 
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Method 


RT user attenuation (dB) 




5 10 


Total rate gap against the upper bound (%) 


Dual-based feas. 


0.16 


0.70 


0.82 


Weight mod. 


9.53 


32.95 


52.35 



Table 3 Average total rate gap as a function of RT user large-scale channel attenuation. 



have the option of finding a better assignment. As a result, the objective does 
not change much when the minimum rate is increased. This can be seen from 
Figure [6] which shows the sum rate achieved by the dual feasible algorithm 
and the weight modification method against the minimum rate requirement. 

4.5 Single User, Increasing Attenuation 

As the user moves away from the BS and the channel attenuation increases, 
the RA algorithm dedicates more resources to the RT user until the problem is 
unfeasible. Figure [JJ shows the average total rate when the large-scale channel 
attenuation of the RT user varies from to 15 dB. The results show that 
for all SNR, the dual lower bound provides a tight solution with the upper 
bound while the weight adjustment method shows a large performance gap. 
Table [3] shows the error in percentage between the objective and the upper 
bound. For an attenuation of 15 dB, neither method is able to find a feasible 
solution; the problem is feasible because the dual upper bound is around 140, 
but the algorithms cannot find a solution. That is, algorithm [1] for the dual 
upper bound finds a solution as long as the primal problem is feasible. On the 
other hand, algorithm [2] cannot find a solution when the solution point is close 
to the infeasibility region. In that case, the algorithm exits declaring that a 
feasible solution could not be found. Also, note that the proposed dual-based 
algorithms provides a near-optimal to the ZF problem (|MT4"|) for all SNRs 
where a feasible solution can be found by the algorithm. 

Figure [7] shows average sum rates. The average is performed over the chan- 
nel realizations that provide feasible points. When the attenuation of the RT 
user is low, most of the channel realizations produce feasible points. When it 
is high, some of the channel realizations do not produce feasible points and are 
discarded. For example, in figure [7] when the attenuation is 15 dBs, none or 
very few of the channel realizations produce feasible points. Therefore, figure 
[JJdoes not show a sum rate for that point. 

4.6 Increasing Number of RT Users 

Finally, figure [5] shows the upper dual bound, the lower bound and the solution 
given by weight adjustment methods as a function of the number of RT users. 
Table H] lists the performance gap against the dual bound in percentage. The 
dual feasible lower bound is again very close to the upper bound. Meanwhile, 
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RT user attenuation (dBs) — > 
Fig. 7 Average total rate as a function of RT user large-scale channel attenuation. 



Method 


Number of RT users 




1 


2 


3 


4 


5 


6 


7 




Total rate 


gap against the upper bound (%) 


Dual Feas. 


0.16 


0.61 


2.09 


2.41 


3.52 


3.20 


3.43 


Weight mod. 


3.5 


3.5 


6.52 


13.86 


22.71 







Table 4 Average total rate gap as a function of the number of RT users 



we can see that the performance of the weight adjustment method quickly 
degrades when the number of RT users increases. It cannot find feasible points 
with 6 or 7 RT users while the dual algorithm yields solutions for these values 
within 3.52% of the upper bound. 

For a single RT user, we have seen in tables [5] and [3] that the difference 
between the upper and lower solution is small. In figure [8j we see that this 
difference increases for three or more RT users. Still, this growth is not large 
and we can consider that a 3.52% is an acceptable error tolerance. Based on 
this, we can claim that it is possible to find a quasi-optimal solution to problem 
(| MT5|) with the proposed method, albeit with an off-line algorithm. 

Furthermore, the results show that the weight modification method has a 
large performance gap which becomes more significant as the number of RT 
users increase. Also, the dual method can find feasible solutions for cases where 
the weight adjustment method cannot. This shows that the weight modifica- 
tion method should be used carefully for RA in OFDMA-SDMA systems with 
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Fig. 8 Average total rate as a function of the number of RT users. 

RT users and that more efficient heuristics should be developed to approach 
the performance of the dual-based feasible solution. 



5 Conclusion 

In this work, we proposed a method to compute the beamforming vectors 
and the user selection in an OFDMA-SDMA MISO system with minimum 
rate requirements for some RT users. We gave a rigorous mathematical for- 
mulation of the Zero-forcing model and then used a Lagrangian relaxation 
of the power and rate constraints to solve the dual problem using a subgra- 
dient algorithm. The Lagrange decomposition yields sub-problems separated 
per subcarrier, SDMA sets and users which substantially reduces the compu- 
tational complexity. We obtained a simple expression of the dual function for 
the beamforming problem for a given SDMA set based on a pseudo-inverse 
condition on the beamforming vectors. The dual optimum can then be used as 
a benchmark to compare against any other solution methods and heuristics. 
The dual function also gives us a better understanding of the problem. Its 
shape is related to the rate constraint activation and problem feasibility, and 
it also justifies the splitting of the subcarrier assignment and power allocation 
processes used in several heuristic methods. 

We then proposed an algorithm which finds a feasible point by starting from 
the dual-based optimum solution and searching among the dual variables of 
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the rate constraints. Numerical results indicate that the two bounds are tight 
so that the feasible point is near-optimal. As a point of comparison, we also 
evaluated the performance of a weight adjustment method which uses weight 
adjustments in the objective function to achieve the required rates. Our results 
show that the performance gap of this approach is large and grows when the 
SNR of a single RT user increases or when the number of RT users increases. 

In addition, the weight adjustment method requires many time slots to 
adjust the weights and schedule real time users. The dual-based method ex- 
plicitly includes the minimum rate constraints which allows RT users to be 
scheduled in the current slot, which decreases the overall packet delay and 
jitter. 

The significant gap between the weight adjustment algorithm and the op- 
timal RA solution, suggests that there is a need to find better heuristics. The 
dual approach looks promising to guide the design of efficient novel heuris- 
tics. To implement the RA algorithm in real time, we also need to design fast 
methods to reduce the number of SDMA sets to be searched. The design of 
these heuristic algorithms is outside the scope of this paper and is part of our 
current efforts. Finally, the upper and lower bounds also provide a very useful 
benchmark to compare the performance of any heuristic method. 

6 Abbreviations 

BER Bit Error Rate 

BS Base Station 

CPU Central Processing Unit 

LTE Long Term Evolution RA Resource Allocation 

MIP Mixed Integer Program 

MISO Multiple Input Single Output 

NLP Non Linear Program 

NP Non-deterministic Polynomial time 

nRT non Real Time 

OFDMA Orthogonal Frequency Division multiplexing Access 
QoS Quality of Service 4G Fourth Generation 
RT Real Time 

SDMA Spatial Division Multiple Access 
SISO Single Input Single Output 
SNR Signal to Noise Ratio 
ZF Zero Forcing 
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